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' Abstract 

' We consider the problem of information flow over Gaussian relay networks. Similar to the recent work by Avestimehr et al. |T|, 

we propose network codes that achieve up to a constant gap from the capacity of such networks. However, our proposed codes 
are also computationally tractable. Our main technique is to use the codes of Avestimehr et al. as inner codes in a concatenated 
coding scheme. 
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I. Introduction 

The recent work of IT] parallels the classical network coding results 121 for wireless networks. That is, it introduces a 
quantize-map-and-forward scheme that achieves all rates up to a constant gap to the capacity of Gaussian relay networks, 
where this constant depends only on the network size, and varies linearly with it. However the computational complexity of 
encoding and decoding for the codes of lH] grows exponentially in the block-length. 
fSJ ! In this work, we aim to construct low complexity coding schemes that achieve to within a constant gap of the capacity of 
Gaussian relay networks. The simplest Gaussian network that has been well investigated in the coding literature is the point- 
to-point Additive White Gaussian Noise (AWGN) channel. There have been a variety of capacity achieving codes developed 
for such channels (see e.g., |[3l, lH, ||5], ™d references therein). 
\ There have also been several recent efforts (for instance [Q and lIS]) to extend the result of |[T] and build low complexity 
relaying strategies that achieve up to a constant gap from the capacity of Gaussian relay networks. However the decoding 
complexity of the proposed codes is still exponential in the block-length. This is because these strategies are based on lattice 
codes, in which decoding proceeds via nearest neighbour search, which in general is computationally intractable. 

In this paper, we build a coding scheme that has computational complexity that is polynomial in the block-lengtlQ and 
achieves rates up to a constant gap to the capacity of Gaussian relay networks. 

More specifically, we build a Forney-type [[9] two-layered concatenated code construction for Gaussian relay networks. As 
our inner codes we use improved versions of the inner code in [T|, which can be decoded with probability of error dropping 
exponentially fast in the inner code block-length. As our outer codes we use polar codes jTOl, which are provably capacity 
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'The computational complexity of all existing codes, such as in (T), also grow exponentially in network parameters, namely the number of nodes |A^|. In 
fact, the codes proposed in this work have the same property. However, for our purposes we consider the network size to be fixed and small. 



achieving (asymptotically in their block-lengths) for the Binary Symmetric Channel, and have computational complexity that 
is near-linear in their block-lengths. 



II. Model 

We consider an additive white Gaussian noise (AWGN) relay network Q = {J\f, £), where Af denotes the set of nodes and £ 
the set of edges between nodes. Within the network there is a source S E Af and a sink nodq3 TZ E Af where the source has a set 
of messages it tries to convey to the sink. For every node i E Af in the network there is the set li = {j E Af : {j, i) E £} Q N 
of nodes that have edges incoming to node i. All nodes have a single receiving and transmitting antenna and the received 
signal Ui^t at node i at time t is given by 

yi,t = ^ hjiXj^t + z^,t (1) 

where Xj^t G C the signal transmitted from node j at time t and hji G C is the channel gain associated with the edge connecting 
nodes j and i. The receiver noise, z^.t, is modeled as a complex Gaussian random variable CAf{0, 1), with i.i.d. distribution 
across time. Further we assume that there is an average transmit power constraint equal to 1 at each node in the network. 

Without loss of generality we assume that network Q has a layered structure, i.e., all paths from the source to the destination 
have equal length. The number of layers in Q is denoted by Lg, and the source S resides at layer 1 whereas the sink TZ is at 
layer Lg. As in Section VI-B of IT] the results of this paper can be extended to the general case by expanding the network 
over time since the time-expanded network is layered. 

III. Transmission Strategy and Main Result 



Encoder 



n 



+ 



u 



■N 



Inner code 
fsi <0 •O 



Inner code 
4n <0 »0 



Decoder 



9, 



9i 



z 



ft; 



+ 



r ^ n 



o 



Fig. 1 . System diagram of our concatenated code design. 
^Just as in wired network coding, this result extends directly to the case of multiple sinks - to ease notational burden we focus on the case of a single sink. 



Our source encoder operates at two levels, respectively the outer code level and the inner code level. The outer code we use 
is a polar code ifTTl (along with a random permutation of bits passed from the outer code to the encoders for the inner code - 
this permutation is used for technical reasons that shall be described later). The inner code is a random code similar to the inner 
code used in H]. The relay nodes use "quantize-map-and-forward" as in H] over a short block-length {i.e., the block-length 
of the inner code). Finally the receiver decodes the inner coding operations, inverts the random permutation inserted by the 
source encoder, and finally decodes the corresponding outer polar code. 

The reason for using a two-layered concatenated code is to achieve both low encoding and decoding complexity, and 
a decoding error probability that decays almost exponentially fast with the block-length. In particular, as we describe in 
Section IIVI our inner codes have a decoding algorithm that is based on exhaustive search. To ensure our inner codes' 
decoding complexity is tractable we set the block-length of the inner codes to be a "relatively small" fixed value. As a result, 
the decoding error probability for our inner codes is also fixed. To circumvent this, we then add an outer code on top of the 
inner code. More specifically, we use a polar code as an outer code, since polar codes have many desirable properties - in 
particular, they provably have encoding and decoding complexities that are near linear in the block-length, are asymptotically 
capacity achieving, and also have probability of error that decays nearly exponentially in the block-length ifTTl . 

One technical challenge arises. Polar codes are capable of correcting independent bit flips, but are not guaranteed to work 
against bursts of consecutive bit flips. It is to "spread out" the possibly correlated bit-flips that would occur if one or several 
inner codes decode incorrectly that we introduce the random permutation mentioned above to the output of the source encoder's 
outer polar code. This random permutation is based on public randomness, and hence is available to both the source encoder, 
and the sink decoder (which can therefore invert it). The system diagram of our coding scheme is shown in Figure [T] We now 
describe the details of the encoding, relaying, and decoding operations used by the source, relay nodes and the sink. Also, 
the source outer code encoder XORs a random string (denoted r, and known in advance to all parties via public randomness) 
to its output after permuting the bits of the polar code, but before passing these bits to the inner codes. This is to ensure 
independence of the inputs to the inner codes, so that concentration results can be used. 

A. Encoding at the Source and the Relays 

The overall communication scheme is over n time instants and has a rate of R = RqRi, where Rq and Rj are the rates for 
the outer code, and each of the inner codes, respectively. The source takes a message w G F2^°^^" of size RoRin bits, and 
first applies the encoding algorithm of the polar code Jo '■ ¥2^°^'" F2^^" creating a string /o(w) e F2^"'" of i?/n bits. 
Once the vector /o(w) is formed a random permutation 11 is applied on all the bits of /o(w) giving rise to 11 [/o(w)] e ¥2^^". 
A random length-i?/77, bit-vector r is then XORed with 11 [/o(w)] G ¥2^'" . 

The derived bit-vector n[/o(w)] is divided in = j, i.e. n[/o(w)] = (ui, . . . , u^r), chunks of size Rj£ bits, i.e. 
Ufc e ¥2^'^ for 1 < fc < iV. Each one of the bit-vectors Ufc is conveyed through the network independently using a separate 
random inner code of rate Rj and block-length £ introduced in [JJ. 

More specifically, all nodes in the network operate over blocks of length £. The source randomly maps each inner code 



symbol € {1, . . . , 2^'^} to a transmitted vector of length I with components distributed i.i.d. from CA/^(0, 1). That is, for 
each 1 < fc < iV the random inner codes operate as Fg ^ ■ {I7 2, . . . , 2^^^} — > C*^, where realizations of Fgj^ are denoted 
fs.k- For each 1 < k < N, each relay node i G Q rounds the real and imaginary part of each component of its received vector 
yi,fe S to the closest integer to form the length-^ vector ([yi,fe]). It then randomly maps [yi.k] it to a transmit vector of 
length £ with components distributed i.i.d. from CAf{Q, 1). For each 1 < fc < iV the mappings at relay i E J\f aie denoted by 
Fi.k: i-^ii^i) with denoting a specific realization of Fi^k- Here Ai = {— Si, . . . , s^} is the set of integers from 

—Si to Si, where Sj is a code design parameter be specified later If the incoming signal at a relay node has a component such 
that its real or imaginary part is larger than Si in magnitude then an error is declared. Finally, the sink TZ receives yn.k E 
associated with inner code symbol u^. 

B. Decoding 

At the end of the transmission scheme, sink TZ receives y-ji E C", which consists of N chunks of length £, i.e. y-ji = 
{yn,!, ■ ■ ■ ,yK.N) where yK,fc G C^. For each chunk yi^k, I < k < N, the sink TZ then applies the decoding algorithm 
gi : ^ 2^'^ of the corresponding inner code (to be described in Section IIVI ). The sink then obtains u^, a possibly noisy 
version of the corresponding inner code length-^ bit-vector that was transmitted during the fc* application of the inner code. 
After decoding all chunks, it then XORs out the random bit-string r added as part of the encoding procedure and then the inverse 
of the permutation applied by the source encoder is applied, i.e. H^^ [(ff/(y7?,,i), ■ • • , 9i{y'R.,N))]- Finally, the sink utilizes the 
polar code decoder in order to produce the estimate for the source message, i.e. w = go (ll"^ [(ff/(y7?,,i), • ■ • j9i{y'n,N))])- 
An error is declared if w 7^ w. 

C. Main Result 

As in lU we define C to be the cut-set upper bound on the capacity C of a general Gaussian relay network, i.e., 

C<C= max mill / {Yn^ ; Xn \ Xn^) 

where Ag — {fl : S E il,TZ E fl'^} denotes the set of all source-sink cuts. We now state our main result. 

Theorem 1. For any Gaussian relay network, the coding strategy described above achieves all rates within (16|A^| + 2) 
bits from the cut-set upper bound C. This code has encoding complexity of 0{n log n + n2^^°^'~^), decoding complexity of 
0(nlogri + n2(''+^^l^l''°S2C')^ ^ probability of error decaying as 0(2"""^'"'). 

The rest of the paper is devoted to proving this Theorem. First we give the decoding algorithm of the inner code that is 
based on exhaustively searching "all possible" noise patterns in the network. Then we continue specifying desirable parameter 
for our code. 

IV. Decoding of the inner code 

In HI they proved that by using their inner code-that is very similar to our inner code-the mutual information between the 
source message and what sink TZ receives is within a constant gap from the capacity. Therefore by applying an outer channel 



code, any rate up to the mutual information and consequently rates within a constant gap from the capacity are achievable. In 
this work, despite our inner code is very similar to that in [1 1 we do not use a mutual information type of argument but we 
instead devise an exhaustively search type of a decoding algorithm for the inner code. 

More specifically once the sink TZ gets the received £-tuple vector (yi, . . . , yi) it rounds every component, i.e. ([yi], . . . , [yt]) 
and then it exhaustively tries all possible messages u G {1, . . . , 2^'^^ and all highly probable noise patterns that give distinct 
outputs to find which was the source message that could have created the received signal. A decoding error is declared if there 
are more than one source messages u that could have given the received signal or if there are no messages at all. 

Since the noise at each node is a continuous random variable there is an infinite number of possible noises that can occur 
even at a single time instance. Therefore it is impossible to exhaustively search all possible noises that happened during all I 
time steps of the inner code block-length. Due to the fact though that every relay node rounds its received signal to the closest 
integer only a countable number of noise patterns would give different received signals. Moreover we will show below that out 
of these infinite but countable many noises there is a finite set of noises that happen with high probability and the probabiUty 
that there a noise pattern happens and does not belong to that set is very small. 

A. Quantized noise 

In the following we will formalize all the above and we will start by giving the definition of quantized noise. 
Definition 1. The quantized noise qi^t for node i ^ M at time t is defined as 



Qt.t = [yt.t] 



(2) 



where [w] is the rounding of the real and imaginary part of the complex number w ^ C to the closest integer 

Since yi^t ~ J2jeQ- + -^i.* shown in Appendix IB] that the quantized noise qi t can be written in the form 

Qi.t = [zi^t] + Ri,t (3) 

where Ri t can take any of the 9 values Ri^t = 0^.4 + 6^ ^1 with = —1, a,;.f , bi^t G { — 1, 0, 1} and t is distributed as CA/'(0, 1) 
for all t e {1, . . . , €}. Equation (O gives that the quantized version of the received signal is given by the quantization of the 
transmitted signal plus the quantized noise. Therefore out of all the countably many quantized noise £-tuples {qi^i, . . . ,qi.i) 
we want to find a finite set Q( called the "candidate quantized noise set" where the most probable quantized noise ^-tuples 
are contained. We will use this set Qc for our exhaustive search algorithm. 

B. Candidate quantized noise set 

One could possible choose the candidate quantized noise set to be the typical set for random variable q, < as defined in 
Chapter 3 of lfT2l . The difficulty with this approach is that we do not know the distribution of f, since the distribution of 
Ki t is unknown and moreover random variables 4 and i?^ 4 are correlated. On the other hand we know the distribution of 
random variables Zi t and we will define set Ze to be: 



Definition 2. The set of Zg is the set of those I— tuples ([zi], . . . , [z^]) G such that 

p(N,...,N)>2-9^ 

where p ([zi], . . . , [zg]) is the probability of the £-tuple and zi are i.d.d. CM{0, 1) random variables. 

From the definition abovqj it is clear that set Zc has at most 2^^ elements, i.e. \Zi\ < 2^^. In Appendix iDl it is proved that 
the probability of some ^-tuple ([zi], . . . , [zg]) {z^ are i.i.d. CJV{0, 1) random variables) drawn randomly from CJV{0, 1) to be 
outside of Zg drops as 2~^^. Moreover in Appendix ICl a random procedure that is based on the "Coupon Collector Problem" 
is proposed on how to find all the elements in Zg with probability of failure (missing some elements of Zg) dropping as fast 

as 2-'. 

The random variable i?, t defined in equation (|3]l takes 9 possible values. Therefore there are 9^ possible ^-tuples 
{Ri^i, . . . , Ri^g) and the set that contains all 9^ such ^-tuples is called set Rg. Now we are ready to give the definition 
of the candidate quantized noise set Qg: 

Definition 3. The candidate quantized noise set Qg is the set of all £ tuples of quantized noise such that 

Qg = {zi + Tj : \fzi e Zg and rj G Rg} 

denoting the sum of all Zg l-tuples with all possible Rg l-tuples. 

From the definition above along with Appendix ICl since we considers all possible ^-tuples of i?i t, no matter what the exact 
distribution of Ri^t is, the probability that a quantized noise ^-tuple Q = . . . ,qi,g) randomly chosen will be outside Qg 
will be given by 

P(Q^g,)<2"2^. (4) 

It is easy to see that the size of set Qg is upper bounded by \Qg\ < 9^ \Ze\ < 9^2^^ < 2^^'^. From now on we will assume 
that if a quantized i!-tuple that "occurs" in any node in the network is outside Qg then this is declared as an error and due to 
© this error happens with probability less than 2^'^^. 

C. Probability of indistinguishability 

As we discussed before once the sink TZ rounds its received signal £-tuple vector {[yi], . . . , [yg]) it exhaustively tries all 
possible messages u E {1, . . . ,2^'^} and all quantized noise tuples in Qg to find which was the source message that could 
have created the received signal. An error in the decoding of the inner code occurs if a noise pattern outside of Qg occurs in 
some node i E JV. Then the decoding of the inner code fails and this happens with probability at most \J\f\2^^ according to 
(|4]l and the union bound over all nodes. Moreover if the noise patterns in all nodes happen inside Qg then the inner code fails 

^The entropy of the random variable [z] where z is distributed as CJ\f{0, 1) is around 4.4 and therefore the typical set as defined in 1121 will contain all 
^-tuples having probability 2^('*-*='='^)^. Therefore set Zg contains the typical set for e < 4.6. 



if there are more than one messages u that would have given rise to the same received signal and in the following we will 
analyze this probability P{u — > u'). 

Assume that the source node S sends message u and the quantized noise realization qg under message u at all the nodes in 
the network is qg = a. Then P (u — > u') is the probability that there is another message u' [u' ^ u) and some noise realization 
q'g under message u' (the two noise realizations are not necessarily different) so that the sink TZ cannot distinguish whether 
message u or u' was sent. Similar to H] equation (70) we have 



F{u^u'\qg = a,qg=h)= ^ 7'ji,a,b 



(5) 



neAg 



where O is any cut in the network and Po.a.b is defined to be the probability that nodes in fl can distinguish between source 
messages u and u' under the noise realization a and b respectively while nodes in 17^ cannot distinguish u and u'. It is proved 
in Appendix |E] that this probability is upper bounded by 



(6) 



Assume that the source node S sends message u and the quantized noise realization in every node in the network is a, then 
the probability that there is another message u' or quantized noise £-tuple in Qg that will confuse the receiver is given by 

P(U ->u') < 7'o,a.b2^^^ |g,|l^l f 2-<C-3|^|)2i?.^ |g^||AA| 

Therefore by setting the rate of the inner code 



i?/ = C - 16 lA/"! - 1 



(7) 



the probability that two messages u and u' will be indistinguishable at the receiver TZ decays as 



(8) 



Finally at each node we have some mappings Fi : (^f , Afj — > C*^ where Ai is the set of integers {— s^, . . . , s^} so that the 
probability of a incoming signal having a component outside of Ai to be very small. Specifically for every node i G J\f there 
is a set of signals that give the maximum absolute value Mi for the received real or imaginary part, i.e. 



max 
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then Si = Mi + Si where Si > corresponds to the smallest slack necessary to make sure that the received signal (transmitted 
signal + noise) is less in absolute value than Si with probability at most 2^^^. If the received signal has a real or imaginary 
part that its absolute value exceeds Si then the noise should have a real or imaginary part with absolute value larger than S, 



i.e. 



(*) / X2\ 

p (z > Si) < Exp f j < 2-2^ s, = iVerk^] . 

where inequality (*) is derived by inequality (7.1.13) at page 298 of ifTSll . 

D. Probability of error for the inner code 

Now we are ready to analyze the overall probability of error for the inner code. The inner code fails if one of the following 
four events happen: 

1) Some node i e A/" in the network received a signal that its component has a real or an imaginary part with absolute value 
larger than s;. According to the analysis above this event happens with probability less than 2^"^^ \M\ < 2^^ for large 
enough £ (^>log2(|AA|)). 

2) The random procedure that finds all the elements of set Qi failed. According to Appendix ID] this happens with probability 
less than 2~^. 

3) The quantized noise in some node i E Af in the network is outside of set Qe and according to Q this happens with 
probability less than 2-'^'^ \Af\ < 2"^ for large enough £ {£ > log^ {\Af\))- 

4) If the exhaustive search decoding procedure fails because there are more than one quantized noises ^-tuples or messages 
that give the same signal to the receiver and according to (|8) this happens with probability less than 2^^ 

and therefore the overall probability of error Pj for the inner code is upper bounded by 

P/<42-^ (9) 

for£>log2(|AA|). 

E. Complexity of the inner code 

In order to implement the inner code one have to find set Qi. This is done by finding set and the random approach based 
on the "Coupon's Collector Problem" to create set requires 0{12^^) order of steps. The most "expensive" operation though 
for the inner codes is the exhaustive decoding that search over all elements in Qi {Qi < 2^^^) over all nodes in the network 
|7V| and over all messages and therefore incurring and overall complexity 2^'^2^'+'^^\-'^\^ = 2(''^^+i3|A/'|)f ^ 2(C'+i3K|)«^ 

V. Complexity and error analysis of the code 

We now specify the value of the parameter £ (which was left open thus far). For reasons that shall be clear in equation (fTTT i 
for the rest of the paper we choose £ so that 

hi2Pi) < I (10) 

where h{x) = — xlogj x — {I ~ x) log2(l — x) is the entropy function. The exact value for the probability of error for the 
inner code is not known but we can be pessimistic and take its largest value Pj < 42^^ given by |9] One possible value for 



I that satisfies inequality (fTOl) as it is proved in Appendix |F] is £ = 3 + [log2 C] and that is the value we will set the block 
length of the inner code to get. 

A. Probability of error 

For each inner code that decodes its chunk incorrectly, in the worst case there is a burst of Ril erroneous bits that are passed 
to the sink's the polar code decoder The purpose of the outer polar code is to correct these bit flips. Out of the N ~ j input 
length-^ bit-vectors to the outer code on average only jPj are decoded erroneously (again, this number is concentrated around 
the expected value with high probability). This corresponds to jPjRji = nPjRj bit flips. Since each inner code chunk has 
independent inputs (due to the XORing operation described in the encoder) and is decoded independently we can apply the 
Chemoff bound and prove (Appendix iGll that the probability of having more than twice the expected number of bit flips drops 
at least as Exp(— O.lS^q;^-^). 

The rate of the polar code is chosen Rq = 1 — h{2Pj) can correct bit flips that are injected in our channel with probability 
only Pj. Therefore when less than twice the expected number of bit flips happen then the polar code fails with probability 
2~{nRi)'^ for any < 1/2 as proved in 1 1 1 ] (the block-length of the polar code is nRj). Therefore the probability of error of 
the overall code is dominated by the probability of error for the polar code is of the order 0(2^"^^^) for ji — \/A. 

B. Achievable rate 

The achievable rate is i? = RqRi or 

i? > c- leiA/"! - 2 (11) 

since Rj = C - 16|7V| - 1 and i?o > 1 - ^ due to 

C. Encoding decoding complexity 

The encoding and decoding complexity of our codes is the following: 

• The encoding complexity for the outer polar code is 0(n log n) while the encoding complexity per inner code is 0(2'5i°e'5) 
so the overall encoding complexity is O(7ilog7i + n2^^°s^) 

• The decoding complexity of the polar code is O(nlogn) whereas the decoding complexity per inner code is 
Q(-2(c+i3lA/-|)iogC^ SO the overall encoding complexity is 0(nlogn + n2(^+i3l-^l)i°S2C-)_ 
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Appendix A 
Proof of Lemma[T] 



Consider the SVD decomposition of H: H = USV^, with singular values cji, . . . ,crmin(n.m)- For every vector f G 
where ||/|l < ^2 then ||/|l < and therefore 
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VI < t < £ : ^ (CT»i,,t + n,t)^ < 2n - ^ 
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t=l \ i=l i=min(n,?Ti) + l 
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(12) 



where equality (a) holds due to the fact that unitary matrices preserve the norm-2 of a vector, (6) holds since vt 
have the same distribution with [x^^l, . . . ^Xij]^ and r = U^r. We will denote by Pj the following probability 



' min{n,m) 
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where u ^ 2n — r^^ and therefore 
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min(n,m) g^p ( - 

Exp [ku] Yl 



(14) 



where (c) is the Markov inequaUty and (d) holds since j are independent for different t. From equation (fT4l i for fc = 2? 
we get 



< Exp 
= Exp 



miii(n,m) T7vn ^^.^ 
^1 -Q 2aHl+af) 



2a 



min(n,m) ~2 

~2 



_^ / min(n,m) ~2 



Exp 



-i 5: ln(l + af) 



and by substituting uj with its value tu = 2n — ff ^ along with the equation above we get 

i— min(n,m) + l 



< Exp 



< Exp 



< Exp 



2a 



2n 



min(n,m) ~2 



E 1+1, 

.n(n,m) + l 1 
min(n.??i) 

-i 5: ln(l + a.n 

4=1 

1 / \ , ■)^ 2n 

- E ln(l + '^f ) - 



Exp 



min(n,m) 



Exp 

min{n,m) 



and combining the inequality above with (fT2] l we get 



fvi < J < £ : H , . . . , + < V2) < Exp 

V 00 / 



i(n,m) 



2n 



2 \ ^ - cr- 



and since, i ^'""H™'") iog2(l + af) = i loga det(I„ + HHt) = / (x; Hx + z), for x, z that are distributed as CAf (0, I„) 
and CJ\f (0, In ) respectrively we get 

P(V1< j<€: ||H[ii,j,...,i„,j]^ + r,|| <V2^ < 2-^(^("'""+"''-^ (15) 

Appendix B 

Rounding to the closest integer the sum of two numbers 

We define as [x] to be the nearest integer to some real number x and if z — a + bi & C for a,b £ M. and ~ — 1 then 
[z] = [a] + [b]i. Assume that hi = xi +yi and h2 = X2 + y2 are two positive real numbers with xi, X2 and yi, j/2 representing 
the integer and decimal part of these numbers. Then if we write 



[hi + hi] = [hi] + [h2] + L 



0.5 1 !/, 0.5 1 9, 

(a) The value of L for [h\ — (b) The value of L for [hi — 
h2] = [hi]-[h2\ + L h2] = [hi]-[h2] + L 

Fig. 2. The value of L for different regions of ( j/i , 2/2 ) and different operations (addition & subtraction) 

the different values of L for different regions of (2/1,2/2) are given in Figure [2(a)] Similarly if we take the difference of hi 
and /i2 and we write 

[hi + hi] = [hi] + [h2] + L 

then the values of L for different regions of {y 1,1/2) are shown in Figure [2(b)] 
Therefore in general for two complex numbers zi , Z2 G C we have 

[zi + Z2] = [zi] + [Z2] + R 

where R can take one of the 9 values R = ri + 7-2^ where ri, ri e { — 1, 0, 1}. 

Appendix C 

a random approach to find all elements in set zi 

The way to find all the elements in set = {zi, . . . , z\Ze\] is based on the well known "Coupon Collector's Problem" |[T4l . 
Let's assume that one creates r (the value of r will be specified later) ^-tuples ([zi], . . . , [zi]) (where Zi are i.i.d. random 
variables distributed as CN{Q, 1)) and denote as the set of all these r randomly created ^-tuples. 

The probabiUty that element Zi E Z( is not contained in the randomly created set A'^ is given by 

P{z,iA-,) = {l~p,Y<e-'~P^ 
where pi is the probability of element Zi E Zg and since pi > 2^^^ = Q then 

Moreover from the definition of Q we get that \Ze\ < ^ and in general the probability that there is an element in Z( that is 
not contained in y4» is 



and therefore if ?- -^^ ^ In ^ ^ ) we have that 



and since Q = 2' 



-9i 



and the number of elements in Al' is 10^2^^ In 2. 



Appendix D 

The probability that a randomly picked £-tuple will be outside set Zi 

Assume that there is an £-tuple Z = ([zi], . . . , \z(\) drawn randomly where z are i.i.d. random variables from distribution 
CA/'(0, 1) then the probability that does not belong to Zi is 



(a) 
< 



E 



[z i z,\ 



ib) ' 
i=l 



'[[p{h])<2' 



■9e 



' 1 

IT > 2^^ 



Vfc > 



p(N) 



(16) 



where (a) is due to Markov inequality and (b) is due to the independence of the ^([zi]) for i E {!,...,£}. At equality (c), zj^ 
is random variable distributed as J\f{0, 1) and the equality holds since the real and the imaginary part of a CAf{0, 1) random 
variable are independent Af{0, 1) random variables. If we define Ci where i E Z to he 



1 ,2 



V2^J^-^ 



e 2 dx 



then 



One can bound Ci by inequality (7.1.13) at page 298 of ifTSl : 



Exp (-P/2) ( I 12, 
Ck < ^\ ' ' I ^ - a/t- I for fc > 



I2tx V Qtt 



and approximating cq < 0.5. From the above inequalities one can find that for k = 0.6, E [p^- ([z^])] < 2.9 and therefore from 
inequality ( fTSI ) we get 



'[Z^Z,]<|£<(0.2)^<2 



-2f 



Appendix E 
Analyzing probability Vn,a,b 



The analysis is very similar to |[T|. We define 

'Po.a.b = P (Nodes in 51 can distinguish between u, u' and nodes in cannot \qg = a.,q'g = b) (17) 

where Q. is any cut in the network. We define the following sets and events: 

• Li{n): The nodes that are in fi and are at layer I. 

• Ri{fl): The nodes that are in fl^ and are at layer I. 

• Ci{il): The event that the nodes in L;(ri) can distinguish between u and u'. 

• Tli{n): The event that the nodes in Ri{^l) can not distinguish between u and u'. 

The nodes in any set A cannot distinguish between the message u and u' if the integer values of their received signals are 
identical, i.e. [yA{u)] = [yA{u')]. Assume that the network is layered and there are Lg layers in total (the source S is at layer 
L — 1 and the receiver TZ is at layer Lg ). Therefore equation (fTTt becomes 

Pn,a,b = P (Tliin), Ci-i{n),l ^2,...,lD\qg^a,q'g^ b) 



Lg 

np 


• (TZiin), |7^,(o),/:,_l(o), J = 2, . . 


• - = a,(7g = 










1=2 
LG 

np 

1=2 


'(7^^(^!)|7^J(^!),/:,(^l),J = 2,...,^-l,9g 


= a,(7g = b) 










Lg 

np 

1=2 


'(7^^(0) |7^^_l(^!),/:^_l(^l),<?g = a,(7^ = b 


) 










Lg 

np 

1=2 


'([yfl,(fJ)(")] = 7^^_l(^l),£^_l 


= a,(jg = b) 










Lg 

np 

1=2 


' (VI < t < € : [HiXi,_,(n),t(w)] + a^,(o),t = 




+-b^,(n),t \'R-i-i{^),Ci- 




a,gg = 


= b) 


Lg 
1=2 


P (VI < t < ^ : [Hia;i,_,(o),t(w) + a^,(o),t] 


= [Hza;i,_^(n),t(w') - 


-l-bfl,(n),t] 7^^_l(^l),/:^ 




= a,9g 


= b 



where H; € C l-R!(s^)|x|ii-i(s^)l is the transfer matrix from the nodes in Li^i{n) to the nodes in Ri{fl). Vectors XL^_^^i2).tiu), 
XLi-i(n),t{'^') the signals transmitted at time step t from nodes in Li^i{^l) when the source S has transmitted messages 
u and u' respectively whereas aflj({2).t, '^Ri(n).t ^6 the noise realizations for nodes in Ri{il) at time t. Inequality (*) holds 
due to the Markov structure of the network and the last equality holds since the components of a, b are integers. 
Note that if A,B e c™xi are complex vectors then 

[A,] = [B,] V^^ ||A-B||^ < V2 



and therefore from the previous equation we get 



1=2 



We are now extending Lemma 1 of O] in the following Lemma that is proved in Appendix lAl 

Lemma 1. Assume [i^.i, . . . , x^.^] for i = l,...,m are vectors of length i with elements chosen i.i.d. from CA/'(0,ct^). 
Moreover Vj G C "^^ are a collection of vectors and H G C "'^"^ « some matrix then 



VI < j < £ 



where x, z are distributed as CM (0, Im) and CM (0, I„) respectrively. 

Therefore since (.i;L,_i(a),t(u) — a;i;^(n),t(u')) Gaussian random variables distributed i.i.d. from CAf{0,2) we have 
from applying Lemma [T] that 



(18) 



1=2 



where Cud is defined as 
Definition 4. We define 

Cud = mini (xn; j/qc | iqc) 
w/zere Xi, i G V, are ij'.ti. CA/'(0, 1) random variables and ft is any cut in the network. 

Finally if we combine ([T8]l with Lemma 6.6 in JT] that gives C - C^id < 2|7V| we conclude that Vn.a.b < 2~^^^~^^-^^\ 



Appendix F 

Evaluation of block-length of the inner code 



We want to find a probability a value for x < ^ such that h{x) < ^ where h{x) = — a:log2 .t — (1 — x) log2(l — x) is the 
entropy function. It requires simple algebra to prove that h{x) < — 2a;log2 x for x < 0.4. Therefore if — 2a;log2 x < ^ then 
h{x) < ^ for X < 0.4. For a; = ^ we get — ^ log2 (^) < ^ =^ ^ C < 1 and that holds for C > 16. From equation 
(|7]i we get that C > 16 for the networks where our code construction would work or else the rate of the inner code would be 
negative. 

So for the values of interest of C as long as we set 2P/ <j2l82^^ < ^ £ = 3 + [log2 C~\ we are certain that h{2Pj) < ^ 
for values of C that are of interest to us. 



Appendix G 
Chernoff bound 



For any random variable A and for every t > 

(*) E fe*^) 

V{A>a)^P{tA> ta) ^ P (e*-^ > e*") < \^ ' 



where (*) is the Markov inequahty. If we assume that A = X^iLi where Ai are independent identical distributed random 
variables with f'{Ai = 1) = g and P(Ai = 1) = 1 — g then the above inequalities become 



^A,>a 



< 



or since t is chosen arbitrarily one can get the tightest bound by 

^ Ai> a] < 

t>o 



P yA,>a <mini^^±l^ 
I - t>o e*" 

The minimum value is attained for t = ln (^^^^fy^ and the minimum value gives the following bound 



\i=l 



K ^ a I V a 



For our case a = 2Kq and therefore equation (fT9)l becomes 



Exp( (l-2g)ln( i-^^ -29ln(2)^ 



if 



It's not difficult to show that 



(1 - 2(7) In ( i-^ ) - 2gln(2) < -O.Sq 



for all q < i therefore the above inequality becomes 



y A: > 2Kq \ < Exp(-0.3A'g) 



In our problem K = N and g is equal to the upper bound of Pi that is equal to 4 2 ^. Therefore 

P (More than twice the expected number of bit flips) < P (More than twice the expected number of symbol errors) < 

< Exp(-0.3542"0 « Exp(-0.15 ) 



